PCX 



WORLD INTEU-ECTUAL PROPERTY ORGANIZATION 
Intenuuontl Bureau 




INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCI) 



(51) International Patent ClassificaUon ^ 
GOIN 21/64, CUM 1/34 



Al 



(11) IntemaUonaJ Publication Number: 
(43) IntemaOonal PubUcation Date: 



WO 96/12942 

2 May 1996(02.05.96) 



(21) International Application Number: PCT/GB 95/02 436 

(22) Internationa] Filing Date: 18 October 1995 (18.10.95) 



(30) Priority Data: 
9421510.0 
9507830.9 
95M 666.1 



20 October 1994 (20.10,94) GB 
18 April 1995 (18.04.95) GB 
8 June 1995 (08.06.95) GB 



(71) Applicant (/br ait designated States except US): CAMBRIDGE 
IMAGING LIMITED [GB/GBJ; St Johns Innovation Centre, 
Cowley Road, Cambridge CB4 4WS (GB), 

(72) Inventors; and 

(75) Inventors/AppUcantsObr US only): ANSORGE. Richard, Eric 
(GB/GB]: 6 Gilbert Road, Cambridge CB4 3PF (GB). 
RUSHBROOKE, John, Gordon (GB/GBJ; 10 Barringtoo 
House, Southacre Park, Southacie Road, Cambridge CB2 
2TV (GB). HOOPER, Claiie, Elizabeth (GB/GBJ; 5 Rother- 
wick Way. Cambridge CBI 4RX (GB). NEALE, William 
Wray [GB/GB]; 53 High Street, Great Wilbraham. Cam- 
bridge CBI 5JD (GB). 

(74) Agent: ICEITH W. NASH & CO.; Peart Assurance House. 90- 
92 Regent Street, Cambridge CB2 IDP (GB). 



(81) Designated States: US, European patent (AT. BE, CH DE 
DK, ES. FR, GB, GR, IE, IT. LU. MC, NL. PT. SE).' 

Published 

With international search report. 

Before the expiration of the time limit for amending the 
claims and to be republished in the event of the receipt of 
amendments. 



(54) Title: IMPROVED IMAGING METHOD AND APPARATUS 
(57) Abstract 

A method of detecting the presence and position of labelled 
material in a sample in which the labelled material either gives 
of light or can be stimulated to do so. The sample is imaged 
onto an image intensified CCD camera which is scanned following 
each exposure. Measurementt are performed on the data signals so 
obtained, to identify clusters of daa values from adjacent regions 
of the CCD array caused by light emitted by the image intensifier 
incident on those regions. The measured signal values are compared 
with at least one threshold so as to distinguish clusters resulting 
from light emitting regions of labelled material from the remainder 
of the sample and the centioid of each light produced cluster of 
data values is computed witfj reference to the camera array, and 
a signal value corresponding to the centroW coordinates is stored 
in a memory together with the ccntroid coordinates of any other 
light produced clusters identified during the same interrogation. The 
coordinates from each of a succession of interrogations of the same 
sample may be stored in an accumulation store to enable a list of the 
recorded light emissions and/or display of the events, to be produced 
by reading out the store. Apparatus for performing this metfwd is 
also described. 
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Title: Improved Imaging Method and Apparatus 

Fi?l<t 9i ipvemiffn 

This tnvendon concerns methods and apparatus for detecting the presence and position of 
materials labelled with a substance which emits radiation in the visible range of the em 
spectrum, on a sample. 

The invention is of application in the field of diagnostics and analysis and for performing 
measurements and amilysis on labelled immunoassays, tissue sections, microbiological 
specimens, cellular specimens, cellular monolayers, reporter genes, DNA and/or protein 
gels and blots. 

It is of particular application to diagnostic analysis of samples in which the concentration 
of light emitting material and therefore the quantity of light from different regions of the 
sample can vary considerably from one region to another in the field of view. 

It is an object of the present invention to provide an improved method and apparatus by 
which light from a plurality of different points in a sample can be detected and mapped 
in two dimensions and quantified. 

It is a further object to provide a method and apparatus as aforesaid which is nevertheless 
capable of detecting and mapping points from which light is being emitted at low levels 
and from such points when present in the same sample as points from which considerably 
higher levels of light are being emitted. 

Description of the invention 

According to one aspect of the present invention a method of detecting the presence and 
position of labelled material in a sample in which the labelled material either gives off 
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or ™ s,i„.,„^ ,„ „ ^^^^^^^ ^ 

... an ™,,e CCD ^„„,„, J 

.he c^.sc p....m .h.„on Mowing .ach .,^„. p,rto™i„, „„ J 

cause, .v ,^ J 

n.ea.u„.e„„ wi* „ ^ „ ^ „ ^^^^^ 

en.....nB ,esionsonab.,W„,a„ria, tan, ™a,.*,„,^,„p,. 

c.n,™,d 0, .ao. p,„.„.^ „, „ ^^^^ 

can,.n ^. ^^.^ ^ ^ ^^^^ ^^^^ ^ 

coo.d,„a„s Of an, o.he, produced c,»,e„ id.„.f„d durin, ^. in„„oga«on. 
The „^ ..y ^. ^ _^ ^ ^ 

succe^K-n of of ,he «™e samp,, i, „ ^„„„„„„ ^„ ^ ^ 

read „„, ,o g,v. a „. „, ,^ ^^^^.^ ^^^^ ^ _^ ^ 

U.e events whicb may also b. superimpose! on an o«,li„. of d« s^npfc. 

According ,o anodic, aspec. of .he preseo. invention a m.d„». „( deiecUng *. presence 
aod posuion of cmLdn, iahelied ma»H., ,n an area of samp,, comprises .he s«ps 

1. imaging *. sampfc onu, U« ph„,ocad,od. of a, imag. imansifi., m.,„,. 
of which provides ihe opiical inpu. for a CCD camera. 

2. repeurivcly ^,„, ^ cCD array of camera, each scan cor„sp„m.i„, ,o „ 
.n»rroga,io„ of ^ charge paneri, on „„, ^ „ ^^^^^ 

.oUowed by a r.se.dng sKp. which im'S^es ,h. b.g,m,i„g „f („,taw.,. 

exposure period, 

3. generating during each interrogation data signals whose values describe the charge 
pattern on the array, 



performing measurements on the data signals to identify clusters of data 
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adjacent regions ot the array indicative that photon emission trom the image intcnsifier has 
impinged thereon, and 

5. identifying a centre position ot each identified cluster of such data values and storing 
the centre coordinates in a memory together with the centre coordinates of any other 
identified clusters occurring during the same interrogation. 

Preferably the data signal values generated for each interrogation are stored and 
subsequently read out by a computing and data processing means for performing the said 
measurements thereon. 

Preferably coordinates from each of a succession of interrogations of the same sample are 
stored in an accumulation store. 

The invention also lies in the further step of reading out the stored coordinates and 
producing a list thereof. 

The method also lies in the further step of operating a visual display system so as to 
reproduce therein the scanned area of the CCD array and modulating the light producing 
element of the display system so as to generate visually distinguishable features in the 
display at positions defined by the stored coordinates. 

Image intcnsifier 

A so-called first generation image intensifier is preferred. 

Noise reduction can be enhanced if a low noise material is selected for the photocathode 
of the image intensifier. 

Preferably a first generation image intensifier is selected having a low noise bi-alkali 
material photocathode. 
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CCD Camt?pi oper|ifjr>n 

Preferably .he CCD camera is operated in so-called -invened .ode" so that contributions 
to background from fluctuations in thermal noise in its CCD array, (so called "shot 
noise"), at room temperatures, can be reduced. 

To reduce dead time, the duration of each interrogation of the charee pattern of the CCD 
array and the associated resetting of the CCD array, is preferably as shon as possible and 
w,n normally be much shorter than the duration of the preceding exposure period. 

According to a preferred featu. of the method, the addressi..g of the CCD array is 
organised so as to define a plurality of sub-regions which together make up the optically 
senstuve region of the camera array. The quantity of photon energy incident on each sub- 
region during ar. exposure period determines the charge to be found on that sub-region 
dunng the h ll.wing interrogation, so that an electrical signal indicative of the photon 
energy madeut on each sub-region can be obtained and stored as an electrical information 
signal for each sub-region. 

Display of CCD cnm>.rn c,pn^| 

For display purposes a light producing element of a scanning disolav svstem may be 
modulated by the said electrical information signal obtainable from the interrogation of the 
CCD array, so as to generate a visual difference between one pan of the display and 
another depending on the level of photon activity on the corresponding sub-regions of the 
CCD array during the preceding exposure period. 

If instead the display system is modulated by signals obtained by repeatedlv reading ou, 
the coordinate accumulation store previously referred to. the display wiU present a 
oominually updated picture of the positions from which light has been detected in the 
sample. 

A threshold may be applied to the information signals so that in the simplest case the 
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coordinates at which events have occurred. 

nordinates for each interrogation, the list will contain an 

■-Mm sfr"""" 

i™,^ i»«n.r», : » -P'- •» """" 

„ *. in,.,. 7 '""l„^"i„,co.^«.»n»«i■'»l«-°"^»'""•■ 
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It a fibre opiic plate is selected whose area increases between the i . 

intensifier, (the area of the latter sn» s.- ^ ' '"^ ^"^^^^ 

or tnc latter still being commensurate with the im.o- • 

By capering „ d,V«gi„g, „„„ ^ . 

importance. ^ '* of major 



Peferminarion nf ^[..j^r.^ 

Having id.„,,fi.d a g„„p o, c,u,.r a, a p<^«e can.,^, „ ^ 

accrac, an. „„,„^ ^,„, ^^^^ ^ ». 



is not 
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limited lo ihe resolution of the sub-regions. 
ior| events 



In ecnenl. ion events arising in the image intensifier nonnally lead to signals of 
„,ag'nitude larger than those due to single photoclectrons and where possible these .on 
event signals must be identified and removed. 

According to the invention this may be achieved by applying appropriate thresholding 
algorithms to the signals from each identified group of sub-regions found dunng each 
interrogation and performing the identification in real time. 

Identification can be achieved by noting the total charge on the CCD sub-regions of a 
grouo perxainin. to an evcm. and noting the size of the group (for example the number 
of sub-regions within the group). Using both pieces of inforntaUon. it is possible .o 
determine the nature of the originating event. The relevant group can then be ident:f,e 
as one arising from a Ught emission in the sample, and its position coordinates stored 
and/or displayed, or can be identified as one arising from an ion event, in which case u 
is rejected. 

U has also been found beneficial to use a lower operating voltage for the image intensitter 
than would normally be employed, since in the case of a first generation image mtens.f.er 
.He effect is to reduce the size and number of internal ion events in the intensit.er without 
affecting the sensitivity to photon events at the photocathode from the sample. 

(11 *iirn'° 'aheiung 

Th, or .IK inv„,... penni. analysis of ,^ — n «. a .a^"ln, 

„,„ss a sa^p,. ^ visu^ny a™. .1— ,y co„pu»U.».. ana,ys. o. =,».nca, 
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.ake-up by .issue and/or ceils, and DNA.RNA or protein hybhdisaaon. 
Since in practice ligh. from che image in.en.ifier will cause char« ,o . • 

(2) Multinic id^ntjfi,, i^K-^iiin,- 

<f P»»n» ™, p„^.,.„ „, „ ^ ^ ^^^^^ 
■nitttem from Uie riuip „t wav.l,„ga„ ,„„ ,,,, ' 



(I) labelling ,h. te, ™„rtal a llgh, ,„,i„i„, 
«pec«.. a„. i, „„, i„ , ^^^^ ^ 
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slice thercoi' after said exposure, 

(3) coupling the thin slice of exposed base material with an image intcnsifier photocathode 
input window, 

(4) imaging the phoiocaihode output onto a CCD array. 

(5) establishing a uniform charge pattern on the CCD array at the beginning of each of 
a succession of exposure periods, at the end of each of which the array is interrogated, 
and the charge pattern thereon is read out before reinstating the uniform charge pattern, 

(6) converting the read-out electrical charge patterns into eicclrical signals indicative of 
the variation in charge over the array, 

(7) position- relating the electrical signals to the array, to permit the presence and position 
of sites of photon activity from the image intensifier (and therefore the position of a light 
emitting material in the sample area) to be identified from the said electrical signals, 

(8) determining from an analysis of the electrical signals, ion events occurring within the 
image intensifier and background noise events produced within the CCD array, and 
excluding therefrom signals relating to all such events, and 

(9) storing coordinates of points approximating to the centre of each site for which 
electrical signals remain with reference to their position in the CCD array, as the 
coordinates of points from which light has been emitted. 

The signals derived from the stored central point coordinates may be used to control a 
visual display device for displaying the points in a two-dimensional display. 

The centre points determined during each interrogation of the CCD array may be 
accumulated in an accumulation store and the two-dimensional display is updated from the 
store on a regular basis so as to indicate all points for which photon activity is attributable 
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from a given sample. 



array 



incident on .he capacitive iunc.ion .he .reater rhe . 

junctions are cioselv packed so that i "P-"- 
iuaciy pacKeu SO tnai m an area of the order nK 

tiuugrn or as monochromatic and onJv ihe iiimi«o« 

-«..n a „,a.™,. ...;:;rjf : ™ " " 
™^ J :: i - 

,m,ii„ ■ ' "'^ Srey level resolution albeit over a 

sn,...r 0, ^„„„ _ ^ ^.^ ^^^^ ^^^^ ^ - 
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Greater or lesser quantisation of the charge may ot course be utilised, the figure of 256 
merely being used as an example. 

Resolution in the XY direction is iimited to the size and spacing of the junctions and in 
the limit, the smallest resolvable point is each junction. When displaying a picture by 
modulating for example a CRT display so that the scanning spot is caused to produce more 
or less light at each point in the display in dependence upon the quantised charge signal 
from the CCD for the corresponding points in the CCD array, the resolution in the final 
display (assuming that the scanning spot size relative to the display area is no larger in 
proportion than the area of a junction to the overall area of the CCD array) will be limited 
by the junction size and spacing in the CCD array. Conventionally the points making up 
the overall CRT display are referred to as pixels and in that event the array junctions can 
also be thought of as being pixels since there is a one to one relationship. AJtematively 
groups of junctions may be linked together and read simultaneously so that each pixel in 
fact corresponds lo a group of junctions, not a single junction in the CCD array. 

In the following analysis, the term pixel is employed rather than sub-region. It is to be 
understood that the reference to pixels can mean individual junctions in the CCD array or 
groups of junctions for the reason given above. However where the display resolution is 
greater than the resolution possible in the CCD the positions of points whose coordinates 
have been computed to floating point accuracy from the data obtained from the CCD the 
positions of these points in the disj^.-y will be displayed to the greater accuracy possible 
as a consequence of the higher resolution in the display. 

Dark level variation and correction 

Whether individual junctions or groups of junctions are addressed as pixels, the charge per 
pixel during read-out of the array (even when the device has not been exposed to any 
light), will be found to vary from one region of the array to another. This variation is 
sometimes referred to as dark level variation and is similar to the problem of so-called 
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"shading" in vidicon teievision cameras. 

The varia.ion can be detennined a. ,hc Ume of .anufac.ure and a look-up tab), provided 
ot correcting signals which can be obtained by synchronously reading out the loolcup table 
dunng subsequent addressing of the CCD array. 

The correcting signals may be applied as an offset to the digital vaiues for each pixel 
dunng interrogation of the CCD array or may be applied as an offset to a threshold value 
wtth which the pixel digital values are to be compared. TT,e net effect is the same. 

Thed3r...evel loo.-up table values can be recalibrated at any time by simply exposing the 
CCD array to no illumination and reading out the pixel value and replacing the signals in 
the look-up table with signals derived from the new pixel signals obtained from the 
recalibraiion read-out. 

Since CCD arrays for use in methods and apparatus embodying the present invention w,l, 
otten be involved with low light levels, dark level correction will be assumed to be 
provided tor the camera. 

C l uster jdenrification and rentmid latvii.-nr ^ir -r- hm T 

The algorithms by which evems can be identified and distinguished from background noise 
signals, will now be described in more detail. 

For any cluster of pixels belonging to an event identified as described above, we have 
available from any one interrogation the individual count q, for each pixel i. n^e dark 
level correction for pixel i. namely b. can be read from a dark level look-up table file 
obtamed as described, and a series of acceptance criteria can be applied to the information 
available from the interrogation assuming a known pixel density on and known size of the 
CCD. 

1 The number of pixels in a cluster N must be between an upper threshold and a lower 
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threshold for the cluster to be accepted as a candidate tor consideration as a light emitting 
point. The upper limit serves the purpose of eliminating from the candidate list, clusters 
which result from anomalous events producing large quantities of light. The lower limit 
senses to remove events arising from phenomena which only affect individual or small 
numbers of pixels, such as for example events caused by cosmic rays passing through, or 
from fluctuations in dark-level generation in the silicon of the CCD. or by ions originating 
in the image intensifier system. 

2. TTie excess of photon activity descriptive pixel signals above a chosen lower limit, 
(which may have to be as low as the dark level value for each pixel), can be added for all 
pixels in a cluster to make a sum S. By requiring S to be within a chosen range, it may 
be possible to eliminate clusters due to ion events in the image intensifier. 

3. In general it has been found that ion events can be eliminated by using the observed 
fact that such events have a differem spatial distribution than light emission events. To this 
end a weighted radius for a cluster is computed, defined as R=y/{a.^ + a,W2, where 
a, and a, are the standard deviations of the q; weighted projections onto the x and y axes 
corresponding to the column and row axes of the CCD array, of pixels belonging to the 
cluster. Ion events can be eliminated substantially by requiring the radius, R. to lie 
outside same range of sizes, (referred to the camera input) such that cluster candidates are 
only confirmed as light emissions if for example R is within a panicular range found by 
experiment. 

4. Assuming that the upper threshold Tl and lower threshold T2 used to identify clusters, 
are pixel dependent (from a look-up table) further refinements of the criteria used to 
recognise or define light emissions involve routinely monitoring the camera sutus 
(including dark level, temperature and gain) to compensate for any drift in operating 
conditions and adjusting or regularly updating the values of thresholds applied, to take 
account of any such drift. Refinements such as these give more accurate and efficient 
detection of light events and improve discrimination between clusters which are caused by 
light emissions, and clusters caused by other events, which can be thought of as 
"background". 
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5. If a first generation image intensilier is used, it has been found desirable to reduce the 
image intensifier operating voltage to optimise the use of the thresholds described above 
for light events. Such iniensifiers can perform stably over a large range of operating 
voltages. Both the number of ion events occurring and the size of S, associated with any 
ion events which do occur, fall away very rapidly as the operating voltage is reduced. 
However the number of light emission event clusters and the cluster radius arising from 
light emissions, remain relatively unchanged so that the size of S, for light emission 
clusters, falls less rapidly in response to operating voluge drop than does the 
corresponding sum (S) for ion initiated events. 

6. Cluster candidates may be analysed to see if any arises from two or more overiapping 
clusters and if so, the separable clusters are stored and independently classified. 

7. Parameters to be measured and values to be checked to enable identification and 
classification may be determined by subjecting a known image intensifier CCD camera 
combination to known events and determining the values of different parameters of the 
signals making up the clusters resulting in the CCD output. 

Multi Labelling 

In a further refinement, samples labelled with different light emitting materials (multi- 
labelling or dual labelling) can be measured using different filters to select particular 
ranges of wavelengths for each label. Separate images and lists of the events can be 
produced pertaining to each separate label material, or the differently identified light 
emission events labelled accordingly in any listing produced, and displayed in different 
colours in a single display. 

Display of sample image 



To assist in analysis of the light emission labelling, the invention not only provides the 
step of displaying on a visual display device the light emission instigated event positions 
tor which coordinates are stored, but also the step of causing to be displayed in correct 
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. . • rhe^ samole from which the light has been 

the picture content m the a P . ^ 
preferably takes precedence over the picture content of the .m g 

u -.Knri first described conveniently comprises: 
Apparatus tor performing the method first descnoe 

• cinosetjaratclv addressable sub-regions of the CCD array. 

(1) means for addressing separately auu. 

, .d..te. 1 '0 investigate the charge in each sub-region during each 
r J roduce an electrical signal indicative of the photon 
.„,.icn 3Cdvi„ >. which h- h^n e,p«»i 

exposure period, 

light has influenced the charge on a piura . 
the preceding exposure period. 

c^u ^ ^ » — - — ' " " """^ °' 

identified cluster of adjacent sub-regions. 



and 



centres of the identified cluster. 

■ „ Hi^nUv svstem to which signals from 
,f«resaid mav also include a scanning display system 
Apparatus as aforesaia may at 
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the memory addressing means can be supplied in svn.h • 

P-uce in .e dispia.v .3.,, di«inl JIT""™ "'^ ^^^^ » 

coordinate values so as to produce noi , • T ''^ 

Has .mpinged ^^cTa J/ ^^^^ '° ^ ~r 

P^-. B. updating t.e disp.a.v on a regular :r::.::r """^ ""^^^ 
memory add«ssi„g. a picture can be generated in the ; ^"^"'i-" 
^ - c^cur together .ith those .hiel J:^::::^'''''^ '^^'^ — 

The invention also lies in apparatus for detecting ,h 

-i«ing matena, in a sample, comprising: «^ ^^^^ 

(1) camera means and image intensity m,, . 

'he input to the CCD camera. ' '^'^^ P™viding 

(2) sample support means for the labelled sample. 

(3) oceans for reoetidvely scan„i„, .he CCD arrav of the CCD 
corresponding to an interrogation of the arrav a„. k. ' 

P«ceded by an e..posure step, ^^"""^'^ ^ ^--S step and 

"nng,«* aid marr»gation of ,h, CCD array, 
(S> »s,»l p,„«s»„8 „e»,s and co„p„,i„, „ 

»Siona „, CCD d^H.,! ^ ""^ 
m..-K««l»». ^ '""'^ '""^>«"y '""dins 

iron, ,h. dara sisnai, „, , ^ 

-'^ina„a„fao..„„n..«„.„,^„, :i; 7 ' 

rererence to the scanned CCD array, and 
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(7) memory means for storing at least the centre coordinates of each identified cluster. 
The memory means may advantageously be such as to allow the centre coordinates of all 
clusters identified during the same interrogation of the CCD array, to be stored therein. 

Apparatus according to the invention further comprises means for reading out the dau in 
the memory and producing a list of the centre coordinates stored therein. 

Apparatus according lo the invention also comprises a visual display system responsive to 
signals read out from the memory means thereby to reproduce in the visual display a 
reproduction of the scanned area of the CCD array, the signals read out from the memory 
means serving to modulate the visual display so as to generate visually disunctive features 
in the display at positions defined by the coordinates stored in the centre memory. 

In order to reduce noise the CCD may be operated in so-called \jsvssM mode, thereby to 
reduce contributions in its output signal due to fluctuations in thermal noise in the CCD 
array at room temperatures. 

Alternatively a non-inveried mode CCD array may be used when fitted with special low 
noise readout circuits. This in fact enables operation of higher read out rates which 
further reduce noise integration periods. 

In either arrangement the use of multiple suge image intensification ahead of the CCD 
enables smaller signals, such as those arising from single photoelectron emissions, to be 

handled. 

The invention also lies in apparatus as aforesaid further comprising an addressable 
memory within which information is stored corresponding to the outline and detail of the 
sample and memory addressing means for reading out from the said memory signals m 
svnchronism with a scanning display device, the signals read out from the memory bemg 
supplied to the scanning display device to produce in the display an image of the sample 
from which the light has been detected by the CCD camera in combination wuh and 
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superimposed thereon visually distinctive points corresponding in position to the 
coordinates stored in the first mentioned memory so that the superimposed points arc in 
correct registry with the image ot the sample from which the light has been detected to 
enable the regions of the sample from which light has arisen readily to be seen. 

A fibre optic taper may be used either as or in contact with the faceplate of the imaging 
system, in which the tapered area corresponds to the area of the photocathode faceplate 
of the entrance window and the larger area at the input end of the taper corresponds to the 
area of the sample. 

Samples to which the, invention mav h e atmlied rnppp p.- 
I. histological sections of tissue such as animal or plant tissue. 



or 



2. high density arrays of oligonuclides. peptides. DNA. proteins, carbohydrates 
polysaccharides where the object is the detection of specific target biomolecules in such 
arrays. 

3. viable (growing) cells - adhered onto petri dishes or microscope slides for example 
cellular monolayers, cell cultures and tissue cultures. 

Ubelling 

This may be achieved in a number of different ways: 

I. a drug may be administered to an animal after which a distribution of the drug in the 
animal is looked for. for example in brain or liver tissue obtained following biopsy or 
autopsy. 



2. a section of tissue or organ is cut to give a thin section of thickness of the order of 10 
to 20 microns and the thin section is exposed or incubated with a label or label ligand for 
example probe or drug for example identification of receptors in cells. 
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4. ... upu,» .,,H,„,ie„ „, „^„^ ^^^^ 

» »a,„„ „ o.„„,„ „ „ „ ^^„„,^ ^^^^ 

example neurotransmitter in the brain. 

5 J.™u„*l^.„, ^ ^ ^^^^^^^ 

6. ..xiccsica, s,.<,i.s ,o id.„,iry „, „^ „ 

.«K«o.. „f ^ ^.^ ^ 

UK specHc ar^B or cells low «h|cl, o« compound i, a«n „p. 

T *,al,,b.„i„, . ^ ^ ^ ^ 

.*n«y n„,„ .Ha. o« speciSc .argc, .oleculc i„ a „„p^. ^ ,„,^„, 
m»y 1« used u, »eas.„ u,c ,„ca,loo „( „a. „„. label 1„ ^ ^ sample. 

Advantag^^ of tf^j^ cv^t^^^ 

Light emission from luminescent and fluorescent samples can be verv weak requinn. a 
very sensitive photon-imaging detector with wide dynamic range. As described above the 
system may include, low-noi. techniques and high gain intensification to capture images 
of lummescent and fluorescent processes. 

™s system can quantitatively imag. the photons emitted by a luminous sample or 
fluorescemly-excited sample of large area (eg microtitre plate of ,40mm diagonal) with 
.Ura-sensitivity and high dynamic range. Single photon electron events associated with 
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photon emitting sites in the sample can be localised in the sample with high resolution, 
namely sub-pixel accuracy (10 micron at the photocaihode). 

The invention will now be described by way of example with reference ,o the 
accompanying drawings in which: 



Figure 1(a) is a block schematic diagram of apparatus embodying the invention for 
detecting light emissions in a sample. 

Figure Kb) is a block schematic diagram of another embodiment of the invention. 

Figure 1(c) is a block schematic diagram of another embodiment of the invention. 

Figure 2(a) is a block circuit diagram of the contents of Box 42 in Figures 1(a) 1(b) and 
1(c), 



Figure 2(b) is a more detailed block circuit diagram of the simplified system shown in 
Figure 2(a). 



Figure 3(a) indicates the logic decision making hierarchy and algorithms of the processing 
system of Figure 2. 



Figure 3(b) is an elaboration of the processing logic of Figure 3<a), 

Figure 4 is a modification of the system shown in Figure 2 for higher speed data 
processing. 

Figure 5 is a block schematic logic diagram illustrating how the different values r"". c"", 
S and N are computed for all pixels in the range 1. 2 ... N. 

Figure 6 is a similar schematic logic diagram indicating how a second order moment R 
can be calculated once t.he values of r"". c"". S and N are known, again on the 
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assumption that a DSP is under software control and is simply forming a series of simple 
arithmetic functions, 

Figures 7(a), 7(b) and 7(c) show three preferred combinations of sample, and image 
intensifier. 

Figure 8 shows how a system can be automated for measuring several samples, and 

Figure 9 illustrates graphically a typical distribution of "counts" associated with one pixel 
in a CCD array, for different events. 

Deycriptjon of drawjqg? 

Figures 1(a). 1(b) and 1(c) show an imaging system to which light from different sample 
arrangements is supplied. 

Figure 1(a) shows how a sample labelled with self-luminous material can be imaged using 
a lens 56 onto the input faceplate of the image intensifier of the camera system 16/22. 

Figure 1(b) shows how a sample can be excited with the light of a chosen excitation 
wavelength from behind (trans-illumination) and the light emitted by the fluorescing 
sample is passed through an emission filter to pass the band of wavelengths emitted by the 
sample and block the exciting light. 

Figure 1(c) is similar except that the sample is excited by light have a selected wavelength 
received on the near side of the sample to the imaging system (epi-illuminaiion). This 
requires use of a dichroic mirror to reflect excitation light and transmit emission light and 
an emission filter to pass wavelengths emitted by flourescing sample and block light of 
other wavelengths as shown. 

Using fluoresein as the labelling material, an excitation wavelength of 485mm can be used 
and the emitted light would typically be in the range 530-650nm. 
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assays 



wavelength nuorescence n^e dii ,n " » ^^"^ or multi- 

enzymes (eg alkaline phosphatase or oemvwH,,.. u- . 

measured Such en^„, J. °' P*"""*^'>«> ^hich may be required to 

«urea. 3UCI1 enzymes could be measured in tK- i 

the sample ,o for examnl« , . • luminescence assay by exposing 

example a solution containing luminescent molecules and hence the 
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enzyme would catalyse the emission o( photons of iight which could be measured in the 
apparatus. In the example of tluorescent assays, the enzyme would catalyse the production 
of tluorescent molecules from non-tluoresceni molecules which could then be detected as 
described above. 

In Figures 1(a) to 1(c) the image intensified representation of the light incident on the 
window 14 appears at output windows 18 and is transterred to a CCD array 20 of a CCD 
camera generally designated 22. 

The photocaihode of the image iniensitler shown at 24 is preferably formed from low 
noise material and is preferably a bi-alkaline material. 

A housing forms a hood over the end of the image iniensifier input so as to restrict the 
entry of light or other radiation which otherwise could affect the operation of the image 
intensifier. 

If the sample 11 is of sufficient contrast or is stained, and the support 10 is itself 
transparent or at least translucent, then a light source can be located above the support 10 
to obtain an image of the sample using the intensifier CCD camera. 

Typically the image intcnsifer and CCD camera arc formed as a unitary assembly and 
comprise "an image-intensified camera" and to this end the two items are shown joined 
by the dashed line 29. 

Where the sample can only be visually distinguished by the camera using reflected light 
using for example polarised light, it may be necessary to provide a second CCD camera 
31 which is movable into position in place of the image intensified camera 16/22 so as to 
image the sample and provide an output signal for storage and display as will be described 
later in relation to Figure 2(b). In this event it is anticipated the cameras 31 and 16/22 
would be mounted so as to be readily substituted one for the other to allow an image of 
the sample to be obtained using camera 31 and sample activity detected by the image 
iniensifier camera 16/22. 
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The CCD array 20 is controlled in known manner by addressing clecironics 30 and the 
signal read oui by ihc addressing of the array during each interrogation cycle of ihc CCD 
camera, is amplified by amplifier 32. Outputs from the camera are provided along lines 
34 and 36, the video output signals being supplied along line 34 and synchronising (clock) 
signals along line 36. 

An oscilloscope or other visual display device 38 is provided to enable the video output 
signal from the CCD camera to be displayed before any processing occurs, and to assist 
in setting up and checking the operation of the equipment. 

The signal along line 34 is assumea to be an analogue signal and to this end a fast 
analogue to digital converter (FADC) 40 is provided so as to provide a digitised video 
signal for supply lo a computer 42 which may for example comprise a standard personal 
computer containing a host processor 44. a host memory 46, a large capacity hard disc 
drive 48 and associated visual display unit or monitor 50. The processing power of the 
PC can be augmented by using a preprocessor/video compression board generally 
designated 52 so that a processed signal is supplied to the PC bus 54 instead of the signal 
from FADC 40. 

The provision of additional processing power ahead of the bus 54 is of considerable 
importance if the speed of data transfer via the bus 54 is inadequate to allow real time 
processing at high frame rates of the CCD, ie if the interrogation of the CCD occurs at 
intervals of time which are insufficiently spaced apan to allow transfer of the data from 
each read-out of the CCD to the PC before the next frame of data begins to arrive. In that 
event one function of the processors 52 is to compress or compact the data before it is 
applied to the computer bus 54. 

Detail of data nrocessiny computer. 



Fieure 2(a) and 2(b) are block schematic diagrams of the computing and dau processing 
unit 42 of Figures 1(a) and 1(b) and 1(c) typically based on a IBM compatible personal 
computer containing a type 486 processor 44 and 8 megabytes of RAM 46. The host hard 
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disk 48 should be of the order of 320 megabytes capacity. The visual display unit is 
preferably an SVGA display. 

The host memory 46 is divided into different sections for storing data produced by the 
camera, and the subsequent processing thereof, but the hard disk 48 is organised as the 
final storage device for the list of detected event coordinates, and as a long term store of 
the data used to n^construct the image of the sample in the SVGA display 50 obtained 
from a preliminary imaging step as already described or from an alternative camera such 
as 31. 

One of the expansion slots of the computer is fitted with a special purpose video 
processing board 52 previously identified as containing the dedicated proccc-sors for 
compactifying or compressing the dau from the FADC 40 and thresholding to achieve 

noise reduction. 

Although shown as mounted separate therefrom, the analogue to digital converter 40 may 
be incorporated on the board 52. A suitable device to serve as the FADC 40 is the twelve 
bit analogue to digital convenor produced by Analogue Devices under the code AD 
1671KQ. 

On the card there are mounted two processing paths in order to achieve higher operating 
speed than if only one is used. To this end one path comprises processor 58 and 
associated frame buffer 60 and the other a processor 62 and associated frame buffer 64. 
Additional similar parts may be employed if even higher operating speeds are required. 

The increase in operating speed is achieved by providing a switch 66 which operates in 
svnchronism with the interrogation of the CCD and diverts the digitised video signal 
arising from successive interrogations of the CCD array alternately to the processors 58 
62. Processors 58 and 62 perform identical functions on incoming dau and each is 
typically a Texas Instruments type DSP TMS 32OC50. 

The function of each processor is to compact or compress the data supplied to it via the 
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switch 66. The latter typically comprises a gate array type XILINX XC3030. 

Noise reduction and a first level of compression of the incoming data is achieved by each 
processor 58, 62 by rejecting data values (and their corresponding addresses) which are 
less than a threshold T3. The data values (and corresponding addresses) which do pass 
the T3 threshold test are stored in the frame buffer 60 or 64 respectively and typically 
each comprises a fast static random access memory (SRAM) such as that supplied by 
Micron under type No. MT5C1(X)8. 

During alternate CCD frame periods, (i.e. exposure followed by interrogation) data is 
supplied by the FADC 40 and switch 66 to the DSP 58 which applies the programmed 
algorithm to the data in real time so that the processed signal is available for immediate 
transfer to the associated frame buffer 60 during the frame period, so that at the end of 
the frame period, DSP 58 is in a position to transfer the processed data in the frame buffer 
60 via the ISA computer bus 67 to a frame store 68 in the host memory 46. 

Typically the dau transfer is effected by direct memory addressing (DMA) across the ISA 
bus 67. 

Since the time for this data to be transferred is not inconsiderable and the processor cannot 
handle signals from the next frame until it has transferred all the data into the frame store 
68, the dau from the other set of alternate frames is directed to the other processor 62 by 
appropriate operation of switch 66. Operation of DSP 62 and the frame buffer 64 is 
similar to that of 58 and 60 and it will be seen that the whole of each frame period is 
available to one or other of the processors to either process incoming data or transfer 
processed data into the frame store 68. Each transfer replaces the data previously stored 
by the other processor. Thus whilst one processor such as 58 is transferring data from 
its t am^ butler, switch 66 diverts incoming digitised data from FADC 40 to the other 
processor and during the next frame period, the process is reversed by operation of switch 
66 so that the incoming data is now supplied to the other processor whilst the first 
processor transfers the processed data in its relevant frame buffer to the frame store 68. 
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Provided the number o( separate addresses and data values greater than T3 is less than 
50^* of all the possible addresses making up each frame, the T3 thresholding algorithm 
will reduce the volume of dau per frame. The frame rate is then dictated by the time 
needed to transfer this reduced volume of data from the relevant frame buffers 60 and 64 
into the frame store 68. 

The compression/compactification function performed by the DSP*s 58 and 62 is necessary 
if (as is usual) the data transfer rate of the host processor I/O bus 66 is insufficient to 
permit video signal data from FADC 40 to be transferred fast enough to permit useful 
frame repetition rates of the CCD lo be achieved. If the host processor I/O bus data 
transfer rate is high enough, then the special input card allowing data compactification 
may not be required. 

Funher data compression can be obtained by omitting from the dau to be transferred the 
second and subsequent addresses of immediately consecutive pixels which satisfy the 
threshold T3, following standard compression algorithms. 

The scheme described requires a means of idenUfying each data item as either an address 
or data value. An otherwise unused bit in each data item can be used for this purpose. 

Where the date is in a sequence of address, dau, address, dau. etc., etc., standard 
compression algorithm techniques can be employed to permit further compression of dau. 

The host processor 44 is programmed lo operate in a plurality of different modes, one of 
which is to identify clusters of data values which are greater than T3 (and thiir 
corresponding addresses), and the precise dau processing route followed by the processor 
to achieve that identification is described in more detail with reference to Figures 3(a) and 
3(b). The cluster tlnding operation requires a number of working data stores to be 
associated with the host processor. The host RAM is therefore organised to provide not 
only the frame store 68. into which the incoming data values and addresses are stored, but 
also a cluster pixel store 70, a cluster store 72 in which the computed coordinates of the 
cluster centres are stored, a threshold store 74, a frame cluster store 76 and a multi-cluster 
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pixel store 78, the function of each of which will be described as the algorithms are 
described in more detail later. Suffice to say, the coordinates which end up in the cluster 
store 72 at the end of each frame are transferred to a cumulative cluster store 80 on the 
hard disc 48. The coordinates may be stored in database format or simply as a list in the 
cumulative cluster store SO. 

The processor 44 is arranged to drive the SVGA display 50 so as to produce thereon an 
image of all the events for which coordinates are stored in the cumulative cluster store 80 
in registry with an image of the sample as seen by the camera. To this end the host 
processor 44 is adapted to transfer the data which has previously been stored on the hard 
disc in frame store 79 and which relates to at least the sample outline, to a screen store 
81 which forms part of the RAM 46 and to transfer the coordinates stored in the 
cumulative cluster store 80 on the hard disc to a second screen store 82 comprising yet 
another part of the RAM 46. Synchronous high speed repetitive addressing of stores 81 
and 82 enables a video signal to be formed for controlling the SVGA display SO and 
providing therein the desired display of the events superimposed on the outline of the 
sample. 

It is to be understood that the dau relating to the sample outline need not be derived from 
only one interrogation of the CCD array but advantageously may be derived from a 
succession of such interrogations whilst the sample is suiubly illuminated as by the light 
source 26. Since little or no processing of the data arising during these interrogations 
is required, a direct link from the switch 66 to the ISA bus 67, via a buffer amplifier 86. 
may be provided on the video input board 52. The processor 44 is programmed to 
instigate the direct link during the appropriate interrogations of the CCD array and to 
direct the data via the ISA bus to the hard disc from where it can be read into the screen 
store 81 when required. 

When a sample is replaced with the next sample, the sample image data on the hard disc 
has to be overwritten by a subsequent imaging of the new sample via the CCD camera. 
The first sample can be saved elsewhere on the hard disk as required. 
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Box 116 temporarily takes over at this point to perform, a transfer of data to the 
accumulation cluster store 80 (to be described,. Control then returns to box 102 to await 
the frame ready signal indicating the beginning of the next frame when the process is 
repeated. 

Thus all valid r and c combinations in .urn reach box 118 where for each identified pixel 
Che associated digital pixel charge value. is compared with a threshold Tl stored in a 
threshold store 74. 
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If q is below Tl. control temporarily returns to box 1 U so that the next pixel address can 
be generated and the next pixel q value can be determined. 

If the q of the identified pixel exceeds Tl. control instead passes to box 120 which causes 
a new cluster to be started in the cluster pixel store 70. 

The r, c and q values for the identified pixel (which becomes the seed pixel of the new 
cluster) are passed to box 122 which now assumes control. 

Using the values of r. c and q in 122, box 124 now attempts to build a cluster around this 
seed pixel. Starting with this seed pixel, the building algorithm checks for any pixels 
adjacent the seed pixel which have q values exceeding a second (lower) threshold T2 and 
which are thus deemed to form part of the new cluster. The algorithm proceeds by 
continuing to add to the cluster the r and c values of all immediate neighbours of both the 
seed and any pixels already identified as belonging to the cluster, until no immediate 
neighbouring pixel is found having a q value that exceed T2. During this process the 
action of box 126 is to assemble in the cluster pixel store 70 the r. c and q values of all 
of the pixels which make up the cluster. 

When the end of the cluster is reached, box 128 computes certain parameters for each 
cluster, including the number of pixels (N). the sum of the counts (S) the centroid of the 
cluster and the radius (R). of the charge weighted distribution of the pixels in the cluster 
by using the r. c. q values of all the relevant pixels in the cluster store 70. 

A number of pixels (N) is calculated by simply counting the number of different r. c 
coordinates entered in the cluster pi.xel store. 

The sum of the counts (S) is calculated by adding the q values of the same pixels. 



cluster centroid coordinates (r— , c-' ) are calculated using the following equations: 



wo 9^/12942 



PCr/GB9SA)2436 



32 





.V 




.V 










1 


1 -'. 


1 -'. 


1 -* 



The computed cluster centroid coordinates (r**"*, c*"*) arc placed in the cluster store 72. 
The value used in these formulae will normally have been corrected for dark level 
variation, as by having the appropriate dark level value b; subtracted first. 

In these equations the index i, of pixels to be summed, takes the values 1,2,3 etc up to 
where N is the total number of pixels in the cluster. .Thus (rj, Cj, qj refer to the row 
address, column address and pixel "count" value for the ith pixel in the cluster. It is 
important to note that whereas r and c are integer values in the range 1 to R and 1 to C 
respectively, and are defined by the structure of the CCD, (ie the number of separately 
addressable regions in the array), r*^ and c"" are floating point values not limited to 
integer values. Hence the centroid position can be computed to sub-pixel accuracy. 

Another cluster parameter to be calculated is the cluster radius R which is a measure of 
the area and charge area of the cluster and is computed in two stages. Firstly the product 
of the q value for each pixel and the square of the r and c projections of the distance of 
each pixel in the cluster from the centroid. is computed, and each is summed for all pixels 
in the cluster and normalised by dividing the sum by the sum of the counts (S) for the 
cluster. This gives a^- in the case of the r projections, and a, - in the case of the c 
projections. The effective radius R is computed using the following equation: R = / {a^- 
(7^2)/v/2, where the values of a,- and a,.- are calculated using the following equations: 

/ -I / -1 

t'l t'l 
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2. A CCD image sensor comprising an EEV/CCD 02-06 frame transfer scientific image 
sensor having the following characteristics: 

a. 512 addressable regions (pixels) per line and 512 lines per field. 

b. each addressable region (pixel) being 22 microns square, 

c. a pixel capacity greater than 300,000 electrons, 

d. non-anti-bloomed for 100% fill factor, 

e. a fibre optic input window bonded to the image area, and 

f. a modified special low noise, on-chip, output amplifier to minimise readout noise. 

3. A CCD driver capable of 18MHz pixel output rate to drive the CCD 02-06 sensor, and 
having the following characteristics:- 

a. a read-out noise performance of less than 30 electrons RMS per pixel with the CCD 
operating at 18MHz pixel range (excluding dark current shot noise), 

b. analogue, low impedance video output and logic level synchronisation pulses, and 

c. an electrically reprogrammable gate array, programmed to drive the CCD sensor and 
provide signals required to interface correctly and efficiently with the processing system 
of Figure 2. 

In another example of the camera the first of the three image intensifying stages may to 
advantage demagnify in the ratio of 40:18. 

Alternatively a 65:25 demagnifying fibre optic taper may provide the input to the first 
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image iniensit'ier of a group of three where the first is a 25:18 demagnifying image 
intensifier. 

The use of larger area input devices provide means for observing larger area samples with 
greater efficiency than is available otherwise, whether lens imaging or contact (direct) 
imaging is employed. 

Adjustment of threshold T3 

Normally the value of threshold T3 described in relation to Figure 2, will be set at a value 
less than or no greater than threshold T2, since otherwise pixels belonging to a cluster 
may be lost. If Tl and T2 are pixel dependent values to take account of CCD dark level 
variation (and gain variation), then the value of T3 will also need to be made pixel 
dependent (and gain dependent) and a looV un tible of values for T3 provided (or a table 
of offset values for adding to T3) and the >Tocessor 44 must be programmed to cause the 
readout of the appropriate value in synchronism with the interrogation of the CCD array, 
so as to provide appropriate values of T3 for the different addressable regions (pixels) in 
the array, as the latter is addressed during each inierrogadon step. 

Higher gpe?^ pptjon 

Figure 4 shows a variation of the computing and data processing section 42 of Figure la. 

The different approach enables data to be processed at even higher speed by usin^ a series 
of parallel processing lines each of which is supplied with data from each one of a 
succession of frames thereby allowing more time for the cluster finding and cluster 
identification steps to be performed on the live data. 

To this end the output from the camera 22 via FADC 40 is supplied to a multiplexer 152 
which serves as a data- switch for transferring data first to one and then another in turn 
of a series ot parallel data processing lines, one of which is identified by dolled outline 
154. Each line includes a frame store 156, a processor 158 programmed in the same way 
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Store 160 tor storing the data relating to 
temporarily held in the frame store 156. 

, u. for «rocessin2 to find dusters and identify 
B, providing a parallel lines, the time ^^^-^^^^TZ ^^ a Umes the frame peHod 
wanted clusters from unwanted clusters, can be made equal 

of the CCD camera 22. 

. „ - - ^» r rroHri: 

til am) the cumulative cluster store ou lu ^ r - 

a SVGA display monitor 50 as previous.. „.,„,rical analysis for 

„ .iiho. Pi.««n »ivi., dau ,0 b. ou,-. .or n.™»c^ » 

example as a print-out via a printer 164. 

a„„ »,d ft».e clusttt Sior. »ssod.>=d «.* l»oce»»or 
a Texas Instruments DSP. 

, i-.i«o«? r— and C-* for a group of pixels 
P,.e 5 Shows shows a logic array as 44. 

in a duster which could be used m place of a single p 

. w r-ioc^ Pixd Store 70 which is implemented 
The list of (r,. values is stored in the Cluster Pixel 



in RAM. 



K. -1 is lo«c which counts through the pixd values stored in the 
The index Store box , I ,s logic whi ^^^^^ 
Cluster Pixel Store 70 and causes each set of U. c.. 



thai store 70 in turn. 
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V.^ v.,„„ .„ p,^.. „„, „ „ ^ ^ ^^^^^ 

T1.e »n,s Of ,h. „ r, <i , ,„ ^ ^ 

73.7. .H. P„*^ ,^ ^^^^ 

zero at the surt of the caJculation). 'niijaiised to 

'3aMdbutfer = (b„((.r + 4cJf„r75a. ' 
83b. where dmsion by S is perloimed. 

z:c::z z: r;r - 

cluster pixel store. ' 

Deuils of the iniUalisation and eatina to oass th,. fin,! 

* * ° CO"''"" of the summation buffer 

Figure 6 Shows an implementation for calculation of radius R again using logic devices 
instead of a single programmed processor such as 44. 



In this implementation, radius R. is calculated once r"- c-". N and S are known 
the formulae given earlier in relation to Figures 3a and 3b. for r--. c-. and S. 
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and how ihcy interact. 

Although not shown m Figure o, a o 

sum boxes 89a and 89b, as in the previous Figure. 

. , «d bv the Figure 5 circuit are fed in (tor example via latches) at 
The parameters calculated by the ngure 

appropriate points. 

ee the TMS320C30. Algorithms for prog 6 

a scries of 

Irfacing assc...d memory (RAM) and input-output ^^ces. g 
technical manual, published by Texas Instruments, mdudtng- 

r H 1003 (Part Number SPRU056B). and Digital Signal Processing 

TMS320C5X Users Guide 1993 (Part Numoe gp^oilA). 

Applications with the mS320 Family (1989 part number SPRAO 

,H .„ use discrete logic chips, for example transistor 
^ alternative implementation would be to use dtscre 

,0 transistor (TTL) logic components. 
,„ eaeh o.' »8»-» * '»•" °'»" ' „, „, ,^ „,„ ,p.c ^ 2. 
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labelled producing the light emission. The sample is then indexed so that the next sample 
is presented tor scanning and subsequent analysis and storage of coordinate data relating 
thereto. 

na ^|c level ^pd threshold (rnrrection 

Normally the dark level response of each pixel is obtained from a measurement of the 
statistical distribution of counts in that pixel for a reasonable number of frames (for 
example 1000) in the absence of light or other radiation. The results of these 
„,easurements may be stored in the threshold store 74 (or a dedicated dark level correction 
signals store 137) and analysed using the host processor 44. A dark level look-up table 
can thus be created in the threshold store 74 (or store 137) by entering the mean value of 
.he dark level response from each pixel defined by its address r and c. Likewise other 
look-up tables for each of the thresholds Tl. T2 and T3 can be created and stored ,n 74 
by adding appropriate offsets to the counts corresponding to the dark level value ot any 
pixel, such offsets being based on measurements of staustical distributions of typical .on 
and other background events, and statistical distributions of Ught events from other 
sources, as required. 

These offsets mav be either constant acro« the field of view or allowed to vary with the 
pixel address r and c. Such variation of offsets with pixel address may be obtamed by 
comparing the response as between pixels when the system is exposed to light emission 
sources which are uniform across the field of view. . 

A typical distribution of photon energy/charge "counts" associated with one pixe. in a 
CCD array such as described herein, for differem types of even, which can occur over a 
period of time, is shown in Figure 9. which should be viewed in conjunction wuh Figure 
3(c). 
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CLAIMS 

1, A method of delecting the presence and position of labelled material in a sample in 
which the labelled material cither gives off light or can be stimulated to do so comprising 
the steps of: 

(1) repetitively imaging the sample onto an image intensified CCD camera, 

(2) scanning the camera CCD array and interrogating the charge pattern thereon following 
each exposure. 

(3) performing measurements on the data signals obtained to identify clusters of data 
values from adjacent regions of the array caused by light emitted by the image intcnsificr 
onto those regions 

(4) comparing the measurements with at least one threshold so as to distinguish clusters 
resulting from light emitting regions of labelled material from the remainder of the 
sample, 

(5) computing the cenrroid of each light produced cluster of data values so produced with 
reference to the camera array, and 

(6) storing the centroid coordinates in a memory together with the centroid coordinates 
of any other light produced clusters identified during the same interrogation. 

2. The method of claim I which includes the further step of storing the coordinates from 
each of a succession of interrogations of the same sample in an accumulation store lo 
enable a list of the recorded light emissions and/or a display of the events, to be produced 
by reading out the store. 
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3. The method of claim 2 wherein the events are displayed superimposed on an outline 
of the sample. 

4. A method of detecting the presence and position of light emitting labelled material in 
an area of a sample comprises the steps of: 

(1) imaging the sample onto the photocathode of an image intensifier means, the output 
of which provides the optical input for a CCD camera. 

(2) repetitively scanning the CCD array of the camera, each scan corresponding to an 
interrogation of the charge pattern on the array and being preceded by an exposure period 
and followed by a resetting step, which initiates the beginning of the next following 
exposure period, 

(3) generating during each interrogation data signals whose values describe the charge 
pattern on the array, 

(4) performing measurements on the data signals to identify clusters of data values from 
adjacent regions of the array indicative that photon emission from the image intensifier has 
impinged thereon, and 

(5) identifying a centre position of each identified cluster of such dau values and storing 
the centre coordinates in a memory together with the centre coordinates of any other 
identified clusters occurring during the same interrogation. 

5. The method of claim 4, wherein the dau signal values generated for each interrogation 
are stored and subsequently read out by a computing and data processing means for 
performing the said measurements thereon. 

6. The method of claim 4 or 5. wherein coordinates from each of a succession of 
interrogations of the same sample are stored in an accumulation store. 
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^- The method of claim 4 ^ nr /; 

10- Apparacus as claimed in claim 9 wherein ,h. 

1 1 . Apparatus as claimed in claim 9 o, 10 »hmin . i™. • 
Phoioca^c. ^ ^a,e in,™.,., ' ' 

12. Apparatus as claimed in claim 10 or 1 1 whe-i. . 

-ctcd ..... a in. nois. ..al.,i matcHa,:::::: " """"" 

rs„:~ r:r" r --^ 

inverted mode contributions to background from n . 

«henmal noise in its CCD array. ,so called "shot noise") at rZ . 
reduced. ^' temperatures, can be 

14. Apparatus as claimed in any of claims 9 to 13 wherein th. h • 

.™ . ^ c^ p.„.. a., and ^1:^:::;:: 

CCD array, ,s amtn.cd ro be as shnr, as possible ,o ..dace dead time. 

.5. Appantus as claimed in clato 14, wherein the said duration is shorter than the 
duration of the ptecedinj exposure period. 

16. Apparatus as claimed in any „[ claims 9 to 15 wherein ,h. ,^ 

iJ, wnerein the addressing of the CCD 
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array is organised so as to define a plurality ot sub-regions which together make up the 
optically sensitive region ol" the camera array, the quantity ot* photon energy incident on 
each sub-region during an exposure period determining the charge to be found on that sub- 
region during the following interrogation, so that an electrical signal indicative of the 
photon energy incident on each sub-region can be obtained and stored as an electrical 
information signal for each sub-region. 

17. Apparatus as claimed in any of claims 9 to 16. wherein for display purposes a light 
producing element of a scanning display system is modulated by the said electrical 
information signal obtainable from the interrogation of the CCD array so as to generate 
a visual difference between one part of the display and another, depending on the level of 

t photon activity on the corresponding sub-regions of the CCD array during the preceding 
exposure period. 

18. Apparatus as claimed in any of claims 9 to 16, wherein a display system is modulated 
by signals obtained by repeatedly reading out the coordinate accumulation store so that 
referred to, the display will present a continually updated picture of the positions from 
which light has been detected in the sample. 

19. Apparatus as claimed in claim 17 or 18, wherein a threshold is applied to the 
information signals so that in the simplest case the modulation is rwo-staie and sub-regions 
which have received photon energy greater than a value for example K, are displayed in 
one colour and all other sub-regions are displayed in a contrasting colour. 

20. Apparatus as claimed in any of claims 16 to 19, wherein the sub-region related 
information signals are employed to produce a list of coordinates at which events have 
occurred. 

21. Apparatus as claimed in any of claims 9 to 20, wherein the sensitivity of the imaging 
system (and therefore overall signal processing and image analysing system) is enhanced 
by optically coupling the sample to the phoiocathode of the image intensificr by means of 
a fibre optic coupling plate. 



